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ABSTRACT 


The ‘purpose ‘o£ this thesis 1s to-determine -the -power 
relationship, through computer simulation, between the 
parametric ANOV and non-parametric Wilson tests under con- 
trolled conditions of error!) non-nornality. 

Data asVsamullatediusane the-12-celi-factorial-ANOV 
model with three levels of factor A, four levels of- factor 
PReand sax iobservations-per cell. - Interaction. is-charac; 
moreZecdnsuch that atsveitece, 1S) proport1onal-to-the-effect 
Biesactor A withthe! conSstantoof proportzonalaty- related) to 
paccor 6. Nonanormalatyooflthe error term, as- characterized 
fimeeores. distribution! types: oV¥skewed ,-leptokurtic. (peaked) ,; 
ana platykurtic! (flat)ii- Four degrees of the. three error dis 
mrmoult LON-ty pes Hanerutadi zed. each, related.to- the. Pearson 
family of frequency curves. 

Three Chousand-seventhundred sets- of data. are. generated 
for each degree of error type. Power as’ then estimated di- 
Pareiy for both the ANOV F tests and Wilson Chi-square tests 
fon Main effects and interaction. Comparison is then made 
Beewect Corresponding tests showing the e€ftfect of error 


non-normality on the power of each. 
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I... INTRODUCTION 


As PEARSON'S STUDY OF NON-NORMAL VARIATION 


The normality of error assumption is a well known re- 


quirement when using Analysis of Variance (ANOV) techniques. 


ite has been «shown, «chowever, »thatsthis requirement is not 


Seqaneent when only typeéywisenrorsis thecpoimtrofiyconcern: 


thevliterature does suggest that error normality .<1s,aire- 


q@u@rement relative to type: ll-error and).correct determination 


G@topower of the test. 


Pearson 


[tl estudvedserror-non-normalaty. for a case in-— 


wolvine+thé sone, way ANOV classification, phasestudyqwas 


BasedJon thé. distribution ofthe correlationsratio 7? iwhich, 


= 


: : : 1 Sil a Ts I AIOE eS : Fanh 5 -s ’ - 
2SqULVALCRE toOlthnerse St@erS Users (SEM SELOT ais; 


tributions were chosen with non-normality of error charac- 


terized by Pearson coefficients 8, and 8,’ and by Pearson 


curve type’. 


0. 
WL>tol. 


B 
B 
pej> OF 
B 
B 
B 


Othe, 
On s6e 
0 B, 
2 16, 
46 8, 
99 B, 


Pearson concluded 


1 


Those chosen were: 


=42e50n(Typeiligvsynmetracal fplatykurtac). 

=(4410) (lypeeVilsisyimetricalcleptokureac) ; 
= 7205 i(TypenVily fsymmetricalileptokuréie) 
=o SeSue (Type cial seskew).,, 

= Seid. (lype. Wits skews 


= 3.85 (Type 1, very skew with: abrupt start): 


that the distribution cf n-, and therefore 


Referemce 2 detines these, Coeuw1 LeElemtseds pe He Wes 


B, = u'/us, where u, represents the ith central moment. 


2 Reference 3 transforms the 13 curve types of Reference 
ZeInto Probability densuty functions. 


r 
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of F,.withine the range ofthe above Six distmibutaonsiades 
quately: met thec"normalaty: of error! \requarenent LorpAmeliysas 
efiVaraances. Héeidturthersconciuded that wathangthisteange 
therer would» be, little» chance: offrejectinge ay trucinudichypoth— 
esas becausersofpnon-normalitysybut thateins thejyextremescases 
of non-normal variation there would always be a danger of 
Beeepting a false null hypothesis.) Thus ,oPearson) suggested 
Eoetuecxtreme casesnofrerrori non-normalityi may resulteinia 
Tequmction of spoweriin the: F test. Hel thereby raisedsthe: ques- 
bromvas> toshow error non-normality would affect the F test 
power for a particular ANOV design. 

Kark 44])5 caitingsthes aboverstudyrby Pearson (1930) and 
a study by Norton as reported by Lindquist [5], extended 
Peasscon:s conclusion relating to type I error to ail fixed- 
emecesvANOY nodels; utilizing then F: dastribution: | Kirk hedd 
Euatrzuanh general, unlesst the departures from normalityyals so 
extreme thatwit cans be! readily detected by? visuals inspection 
Si tne data,’ the: departure, wild have: littlesetffect on» the 
prObabadity- associated with the test: of, significances (type 
imier rod) ic oHowéver,, Kirk madesnoe references tot the effect of 


nonenormalityoon’ the’ power of the tesit< 


B. A NON-PARAMETRIC ANOV TEST 

The problem of meeting the error normality assumption 
for using the parametric ANOV F tests is avoided by choosing 
a non-parametric test. A search of the literature was made 
to find such a test which included a non-parametric method 


for testing interactions in the ANOV model. Wilson [6] 


ee ? ot fo ¢ <. 


0° ae 


(ws Wiheten? a5109 fret’ g ue bole 


as ae = wi 


developed sucha) test; based om the Chi-square distribution, 
for testing hypothesis in two-way, three-way, up to n-way 
ANOVedesrens:’ Theytest procedure, tapphicabiie tonliyetostixed 
effects models, involves classifying the scores pimveach 

cell as above or below the overall median and using the fact 
that a total Chi-square; like»va sum of squares, can besde=- 
Composed into additive parts.  sA newuset of formulas carevin- 
procuced sfor «working \withsfactorizal «designs im |) Chi-square 
eormcn sAcdescruption of the ‘tést imchuding thé] Chissquare 
formulas is contained in Appendix A. 

Sheffield [7] showed how the Wilson test could be con- 
verted to a conventional ANOV procedure, whereby the Wilson 
Gia-square formulation could be replaced with “non-parametric 
mm cests. 

MeNemaxr [8] contrasted the outcomes of the Walsem ‘ese 
aillaecie parametric F test on seven batches of data, each in- 
VOlvying two-way classification. Based on 21 comparisons (A, 
Eewand AxB etfects) he suggested that the power of the Wilson 
tests was lower than what could be reasonably expected. How- 
ever, McNemar failed to determine what constituted "'reason- 
able" power for the Wilson test. In addition, he based his 
conclusions on a small sample which he admittedly assumed 
met the parametric ANOV requirements of normality and homo- 
Seacacity. To the author’s knowledge, the literature does 
not report any other attempt to obtain an indication of power 


tor the Wilson’ Chi-square tests. 
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Ci: TYPE OF INTERACTION 

Willaams: [9] studied the problem of“interpretin the 
effects of different. factors® when® those effects are neotvad- 
dative.’ ‘He pointed’ out that attention must.’ be~pard? to the 
wayean which the* factors! interact.) VHe sugpested*thae a rea- 
sonable assumption, in the two factor Case, was to consider 
Piat the’ interaction effect was proportronal’ to) the exriect 
Sasone’factor*with’ the’ constant of proportionality” related 
bo ther second’ factors (i.e8, Co Ge = oye) Williams 
faorusedithecquestion as*to°the effector the type° or: intér- 
Peeron on powersof thé itests' for hypotheses ‘concerning main 


Eeroces aswell as intéraction in’ thetfactorial ANOV design: 


D. POWER OF “THE TEST 

Power of the test 15 déefaned as the probability vor ne 
meeeime a2 false null hypothesis. Power functions have been 
developed for parametric tests, since these tests are based 
on assumed known distributions. Power curves for parametric 
ANOV tests are contained in the Appendix to Reference 10. 
Ome of the arguments for entering these curves is ¢, a func- 
tvon oO: the factor non-centrality parameter and error vari- 
ance. Formulas for obtaining the argument $¢ for ANOV designs 
vol Vins Dinteraction lare ‘contained ‘in "Reference “Il; 

Siégel "P12] proposed that the power of non-parametric 
tests can be expressed by comparison with the most powerful 
existing parametric test that 1s ‘used tor the “Sane purpose 
waUce Miorpower functions ‘exist for “the “distribution-Lrec™ 


non-parametric tests. Siegel pointed out that the more 


bG-maliicay wi?- boi 4 ( nes4 


general the non-parametric test (the fewer theyvassumperems) 
the less powerful the test will be in comparison with a 
parametric test involving the same sample size. He further 
Staced that ‘the Prtest, sbécause ofits stronepassumptiems. 
Poethe most powerful 'test of its ‘type alUSiegel scalledshis 
pemer Comparison concept “power tefirenencpa | itiszs agfiime- 
Proneot the ineréase invsample sizé of the mon=parametrie 
Mesevover that of thé (parametric test whreh sis Meécessary, 
to make the two tests equally powerful. 

mheoreticalliy , othe ipowersoftaastatisticalttest; Iparas 
Mecrie*or non-parametric, can also be estimated empirically 
Picoueh computer simulation. A Simulation model for a par- 


Exeutar ANOV design; can be constructed and data generated 


imei che data, The null hypothesis, that the “bualeai” 
Grrect 15 not present, is then tested at a desired level of 
Sapmaatcance. Power at the desired level of significance 
ieemeasured by taking the ratio of the number of times the 
earse null hypothesis is rejected over the number of times 


poe EeSt 1s conducted. 


BS PURPOSE OF THESIS 

The purpose of this thesis is to develop a computer 
Simulation model for obtaining a power comparison between 
the parametric ANOV F tests and the non-parametric Wilson 
Chi-square tests under varying conditions of unimodal error 
Mon-normality.” It.is envisaged that the general method! will 
be applicable in determining the power of other non-paramet- 


mre tests. 
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Ti. -METHOD 


A. ANOV DESIGN AND GENERAL PLAN 


A 3x4 ANOV design with six replications per cell was 


chosen because of its general nature and because it was de- 


sired torcompare interaction detection capabilities of the 


Wilson and F tests, as well as that of main effects. The 


ieeiod developed is presented in five parts: characterizing 


Error, Characterizing interaction, the data simulation model, 


Ehe computer, program, .and determination of test replications 


for desired confidence. 


Bic CHARACTERIZING ERROR 


Oniyeunimodale errorrwasiconsadered:e Exroriwasmweharac- 


Eerazed as skewed, leptokurtic; andsplatykurtic: ©¥Four: degrees 


Sere achs types were’ considered; from’ violent’ to almosts normal. 


The; degenerate case forveach error distribution type wasothe 


normal error distribution and this*was consadered as’ av fifth 


degree: 


Each degree was identified by Pearson coefficients 


B, and 8,. For continuity with Pearson's work, some degrees 


were chosen adentical toothe error distributions studied in 


Reference 1. All error distributions were selected with a 


mean or 0 and a variance of 4. 


C. CHARACTERIZING INTERACTION 


interaction was characterized as foisows : 


: ped Lewes 
(a8) 55 = o4¢; a aie (1) 


10 


where ere were constants, evenly spaced, increasing and 

; C; = 0.. » (Notes that) the “evenly spaced”. andQianepeasang! 
features aré not required.) This characterizatiom resulted 
imethe iteractionseifect, (eae being proportional to 


ehe-ettect of factor A, Oss and increasing with each level 


@e tactor B. 


D. THE DATA SIMULATION MODEL 


1. The Mathematical Model 


(2) 


ls ge gt ee COR ak 


Z:3, represents the error which under the ANOV assumption 1s 
Peeeriboted N(0,c7). It waS the distribution of Ehis error 
term that was changed from normality, but with a constant 
warrance of o* = 4, in order to determine the effect of non- 
nermality on the Wilson and F tests. The development of 
equation (2) into the twelve cell models shown below is con- 
taimed in Appendix B. 


Model for cell one: 


ei Mt Sy By oe) eae Kote. (>) 


Model for cell two: 


Mie Mt ie, * Bot CAB) * Apo Kel ee 
Model for cell three: 
Oi Oy ea NOR I ake Kol sh) 
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Model for cell 


Vie 7 ee Oy, > Bo, 


FO UT : 


Bl > Big = (a8) 44 


(oB)i3 + 214 


Model for cell 


Loic Prabetucg st iBy 


Model for cell 


tye 7 Ut 5 * Bo 


Model for cell 


3, a hag of 


Model for cell 


a 7 Ney By 


five: 


+ (aB)o, + 201K 


(OB)o~ * Zag 


Model for cell 
Pi YM Sy ee 


bie eZ, 


Sileke 
Model for cell 


Bole deb wecl wee 


deez, 


32k 
Model for cell 


Ce auhee We oo 


nine: 


Ye gy (oR aT 


WZ 


(0B) 5 


k=, 42.6. 


(AB) 54 


(6) 


(7) 


(8) 


(9) 


(10) 


(11) 


(12) 


(13) 


Model for cell twelve: 


Yoak = Mo ~ Oy — Go Zee, ~ Bo “\8z + Cob) ia = lee 


ete OE) a iam 


k=1,°°,6. (14) 


Procedures. for penerating ernoravaritates ak and 
for,determining the parameter values ay» do5°**, (0B) are 
piven below... lt may be noted that several of the parameters 
Srecauation (2) thavexdropped-oute of the twelve cell models 
asacxplained in Appendix B. 


Z- Generation of Exror, 255k 


a, eNoOrmal Error Dist ribuctLon 


ance or, 4, were generated by using the central limit approach 
Contained in Reference 13. A normal variate z was made by 


applying the following simulation formula: 


i) 
=o, (PY bs as 
i=l 
WHETE ; 
Be desired mean of the normal error variate (here=0), 
oo desired standardideysation of the normal error 


wMeartate (here=Z), 


r a Uniform (041) -randomenumbery cand 


k 


iH 


number of random variates desired for approximating 


a normal variate by’ the central limit approach. A value of 


LS 


re) 


ean ay ae 
| [> 


a 


k=12 was chosen for convenience which reduced (15) to 
12 
Zi aoe ag ets G20 1. (16) 


i=l 
b. Skewed Error Distribution 

The most vaolent degree of skewed error was san 
exponential distribution and was generated using the expo- 
femtial generator shown in Reference 13. Advantage was taken 
Geeche fact that 

f= Jexp aes Zz 
> 
Uy 

and 


Zee Shue lo gtary, (17) 


were 2 IN this case iS an exponential variate with desired 
mean of Li, and desired variance of oF = We = 4. The variate 
z was then transformed by the below formula to obtain a mean 


o£ 0:. 


The other three degrees of skewed error were 
generated with the gamma (erlang) generator of Reference 13. 
The simulation formula was developed from the probability 


@ensaty function (pdf) 


OF BZ 
BICZ,) = ae (sb cae (18) 
where a > 0, k iS a positive integer, and z is a non-negative 
Emeane Vatiateé. Here 
We 
Q = —_—— 
ik 
Z 


14 


and 


> 
iH 
= 
NN 


Oo 


N & 


Erlang variates were made by taking the sum of k exponential 


Variates, 


k 
z ove Ll top |r, | (19) 
a i 
i=l 


Since hs had to be greater than; 0 im the simulation equation 


(lay. the below transformation was used to transform the 


Aaa es aa Ri (20) 


itewtnree combinations of a and k chosem to penerate the 


three levels of erlang variates with mean 0 and variance 4 


were: 
a k 
7510) 16 
0 4 
en hp Ze 


e. ,Leptokurtie Error Distribution 
The four degrees of leptokurtic error were gen- 
erated by sampling from an empirical cumulative distribution 


mci ton (cdf). The below pdf equation for a type, Vil 


DS 


Pearson curve (leptokurtic) was obtained from Reference 


oe 
2 -~m 
® x 
b aaa es ea ae (Zi) 
a 
where 
5B. = 9 
Tne d2 (BGS Bessie Fe 
WON 
ne = Tee and Uy = desired variance = 4, 
2. 
ae ea ee as and N = number of desired 
avT Tr (m-4) variates in the 
distribution 
and 
xX = abscissa’ index value for the associated 


Ordinate density value, y. 

Miemnindred index values £rom|\-12°70 to + 12.0) six standard 
deviations, were used in making an empirical pdf by computer 
Samulation. A routine was incorporated into the program that 
calculated the mean, variance, unbiased estimates 8 and 8, 
E@oeeLequencies at the 100 index points (1.e., histogram 
prequencies). This was done to insure that the error sener- 
geucaewas accurate. The pdf was converted to a cdf by succes- 
Sively summing the pdf values along the same horizontal axis 
farce to +12.0). A Uniform (0,1) random number was then 
generated and used to sample from the empirical cdf. A 
Bpauary search technique was incorporated in the computer pro- 
eram at this ''sampling™ stage to reduce computer time. The 
error variate was determined by interpolating between the 


two index points on the horizontal axis which bracketed the 


16 


probability value from the cdf that ‘corresponded to? the? sam- 
pling random number. 
di.” Platykurtic Error Distribution 
The four degrees of platykurtic error were gen- 
erated by a similar empirical cdf sampling method. The pdf 


equation determined from Reference 3 for a type II curve was: 


x2 \™ 
niet es ee a? (22) 
where 
5B. - 9 
i EST 
Yan alles 
Bee ee ee eel 
Se = Bo 
y= ee ued 
O a T (m+1) 


as 


Poaiiilar routine for calculating mean, variance, By, ca 
and histogram frequencies was also included in the computer 
program for platykurtic error (and also for skewed and nor- 
Mamerror) to insure that the results’ were as desired, “se- 
fected computer programs are attached following the appendices 
fomcurs thesis. Smooth histogram curves for the degrees of 
Seger error type are shown in Appendix C. 
3. Model Parameter Values 

The Wilson test was the first claimed distribution 
Bmee tWethod, for testing. interactions, im, the, ANOV, model .) there; 
fore, determining the. power of;such, an. interaction, test was 


aaprimary+ consideration. It,was.desired,to, chose parameters 


for the 3x4 model (equations (3) through (14)) which would 


d bere 


guarantee that the power of ethe parametriesr( testiteucime 
teraction would be in a sensitive range on the ANOV power 
curve. After studying thesappropriate power) curve ;gshown 
mieappendix D, a desired interaction test power on .jom was 
shosen.y elhis gavesal¢n(curvetareument) SwaluctoLalase eiWork- 
mevbackwards from this, subject ‘to: thesconditions given in 
Appendix Btand theschosen interactiontcharacterization, the 
below parameter values were determined for equations (3) 
tmrough~(r4)\.9 See Appendix D for development and computa- 


EONS . 


i = -100-002 

a, = =e OS 

A. = C28 

B, = UA (0)5) 

BS = =1..05 

B. = IAS 
(0B) 44 = PeAe SZ 
(o8)15 = 0.4944 
(a8), 2 = 0.4944 
(a8) 54 = -0.4032 
(a8) 55 = ~ Ox. 344 
(0B), = 0.1344. 


Ec THE COMPUTER PROGRAM 
The generation of error variates was incorporated into 
ene Main computer program. <A different "package" was written 


for each degree of each error distribution type. Six different 


Is 


replication+sof error variates were then sapplied imleqehtot 
the 12pcell models itohproduce #72 tobsexrvations stomitestime 
by the parametric ANOV F tests and the Wilson Chi-square 
£EStS < 

Separate subroutines were uwrreten jfor ithe iparametrire 
ANOV cand Wilson tests. F and Chi-square statistic values 
were computed for main and interaction effects. 

In the main program these computed values were compared 
towcne threshold values from the F and Chi-square tables ae 
Piero per cent Level of Significance. If the calculated: 
Giecit-square value was greater than or-equal to the thires- 


Noid value, the false null hypothesis was rejected and 


"cCounted."' The total count was then divided by the number 
See times the test was. conducted to entain the power of tne 
test. 


Flow charts of the main program, subroutine ANOV, and 


subroutine Wilson are shown in Appendix E. 


F, DETERMINATION OF TEST REPLICATIONS FOR DESIRED CONFIDENCE 

Stein (1945) showed how a sequential sampling procedure 
could be used for establishing a confidence interval of fixed 
length e for estimating the mean » having a confidence coef- 
meeteme > Ia. 

This procedure was used to establish the number of test 
Mepliecations (N) necessary to obtain at least 95 per eent 
Gontidence of being within +0.02 (e = 0.04) in determining 
power of the test for the three F tests and three Chi-square 


teSES < 
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Stein's theorem and proof are contained im Reference 
4. Application of the theorém to obtain N is )shownanesp- 
pendix! Fo) They computeriproepram(utubwged msyattached follow 
ine the appendicesecs ,Thedresult waseN =f3700  sihbis)wasmtne 
Hexinume of) thes replications» required, for the six, tests. 
mee decidine: test was) the: Wilson, Cha-squares test, forrthey A 


Grow) effect. 
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III. VALIDATION 


AS DETERMINATION OF THEORETICAL POWER, ANOV TESTS 
Aststatedtabovesdatdesiredi power o£ 0 767i toretheraiey 
igceraction téstiwaseused) in determining the’ simulation 


model parameters. Using the below equations from Reference 


bh y r 
iG as as 
age = 
on a and (23) 
E 2 
gee hapee sis 
=1 
on 7; a ad ; (24) 
ore 


and substituting applicable parameter values, theoretical 


powers for the testing the A and B main effects by ANOV F 


4 


BoeouweTs TroOud.oco be 0.di and. 0.96 Fespettivery.  Car- 
culations and the applicable ANOV power curves are contained 


imeeppendix G. 


BE ANOV POWER SIMULATION RESULTS, N(0,4) ERROR 

Three thousand-seven hundred data cases with N(0,4) 
error and the predetermined model parameters were tested 
with the ANOV subroutine. Power was computed and compared 


Wiraethneoretical power. 


EPPECH A B AxB 


Theoretical W/ 0.81 0.96 0.67 
N(0,4) Error 


Simulated W/ 0.808 0.960 0.665 
Ni(0.,4:) Error 


Ze 


Cc. ACCURACY CHECK OF WILSON SUBROUTINE 

One hundred data cases with N(0,4) error and predeter- 
mined model parameters were tested with the WILSON subrou- 
fine. Printout wasimadelon’tmedian: calculation; vcontingency 
fipkez-cand Chi=-sSquare\valuesi(totaly ASSBSWAKB)s. Fiweuost 
Bie Gases were.then selected at random and’ the same’ values 


memercealculatedseby*hands« Results weresexactly*the same. 


Dy. SIMULATION OF LEVELS OF SIGNIFICANCE 

Parameters of the simulation model, other than the over- 
Bieemecan, were set equal to zero. Then 35/00 data sets were 
produced with N(0,4) error and tests conducted with the ANOV 
and WILSON subroutines. Based on this sample size the true 
evel of Significance was estimated within plus or minus 
feoeewichn OS per cent confidence: That 1s; by choosing F 
ana Chi-square threshold values for rejection at the 5 and 
mMeger Cent Significance level, the chance percentage of 
Teqeetions should have been equivalent, within the criteria, 
Fomueo5 and 0.10 for-each of the ANOV F and Wilson Chi-square 


tests. Results were: 


5 PER CENT REJECTION THRESHOLD 


EFFECTS A B AxB 
ANOV F .0565 nOSS5 .0508 
WILSON x? .0586 .0486 .0411 


10 PER CENT REJECTION THRESHOLD 


EPRPEGES A B AxB 
ANOV F sO Si . 1089 s0995 
WILSON x? ~0 754 .0884 .0954 


Vy 


IV. RESULTS 


Three thousand-seven hundred data cases for each Oeeene 
fous, degrees of skewed, lLeptokurtic, and platykuxtre error 
were tested with the ANOV and WILSON subroutines. Results 
arengiven. below in three tables)5 Eachitablelgives (the 
pomen, Of the testitor.the thrée Jetiects hypotheses jwithed 
Mametcular type error.’ Pearson coefficients are shownWsor 
reference, as well as the actual means and variances of the 
Sironidistributions generated. .The last.column of each 
Bapto eon ves the power of the test with -N(0,4)-error-tor 
convenience of comparison. Error degrees shown correspond 


Eoeene curves of Appendix C. 


ZS 


ERROR DEGREES 


1 2 3 4 5 
SKEWED B,=3.97 By= £95 B,=0.99 B,=0.26 B,=0.00 
ERROR B,=9.03 B5=5.96 Bo= Dei B5=3.47 B5=2.95 
DIST'N (EXPON) (NORMAL) 
COMPUTED DIST'N 
MEAN 0.00 0.00 0.00 0.00 0.00 
comeuTeED DIST 'N 
VARIANCE 5.97 5298 3.98 Say 3.98 
Pea =, 0 
re) al 
: 2 
Hy: zs oe 7 0 
POWER ANOV Or 8:2 OQ. 82 One Ov.0e2 Oa 
POWER WILSON 0.74 0.64 Or oe OTS. Ona 
a ae 
ee > 5 0 
, 2 
Hy: y [5 # 0 
POWER ANOV 0.95 0.95 0.96 0.96 0.96 
POWER WILSON OSS 0.91 O=s5 Cee lacs) 0.74 
Hy: Le Cee = 0 
Hy: 22 (0B) 4; # 0 
POWER ANOV 0.68 Oo 0.66 0.66 0.66 
POWER WILSON 0.36 0.30 O27 0225 O25 
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ERROR DEGREES 


Hf: Z 5 4 5 
LEPTOKURTIC B,=0.00 B,=0.00 B,=0.00 B,=0.00 B,=0.00 
ERROR B,=20.00 B,=7.05 B,=4.10 B,=3.40 B,=2.95 
DESL N (NORMAL) 
COMPUTED DIST'N 
MEAN ce a 0) -0.11 -0.12 =O <L2 0.00 

COMPUTED DIST'N 

VARIANCE 32616 3.93 5+ 9:6 GeO] 3.98 

; - 
Hy: oe o = 0 

F 2 
Hy? y on # 0 
POWER ANOV OraszZ Oest 0.81 OF8H Oest 
POWER WILSON 0.56 OvnSS 0-50 0.48 Ons 
— ee ae eee ST SS i OS acai one ae 
Hy y Bs 0 

: 2 
Hy: mB ¢ 0 
POWER ANOV 0.96 0.95 0.96 0.96 0.96 
POWER WILSON 0.86 Ors82 0.78 COSTS Ona 
Hy: yy as = 0 
Hy? ZZ (08);; # 0 
POWER ANOV 0.68 One Gu O66 0 7616 0.66 
POWER WILSON Ores0 Or2'S OFZ6 Dewars O25 


ERROR DEGREES 


if 2 5 4 5 
PEATYKURTIC B,=0.00 B,=0.00 B,=0.00 By> «0 B,=0.00 
ERROR B,=1.80 B,=2.00 B,=2.25 Bo= = 50) B4=2.95 
DEST 'N (UNI FORM) (NORMAL) 
GOMeuUrED DIST'N 
MEAN 0.00 =0.03 =O 20:5 =0) 06 0.00 

COMPUTED DIST'N 

VARIANCE SOF 5.97, So 5.07 3.98 

. Jee 
Hy: om a; = 0 

. 2 
Hy: ny 5 # 0 
POWER ANOV Cereb CO coat O82 0. 82 OneGil 
POWER WILSON Or eau) 0.40 OAZ 0.44 Osa, 
ee eer. 8 

. 2 
Hy: y B: # 0 
POWER ANOV 0.96 0.96 0.96 0.96 0.96 
POWER WILSON O55 0.60 SOs) 0.68 On74 
Hj: 22 (08) 5; = (I 
Hy? ap Gol aie # 0 
POWER ANOV 0.65 OOS 0.65 O65 0.66 
POWER WILSON 0.18 O20 Oa2e VAS 0225 
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V. ANALYSIS AND INTERPRETATION OF RESULTS 


A. HYPOTHES [Sa TEST sPOWER=CURVES 
Freuresul;(2Zyaand0339whvch)are attachedyiollowinge this 
section, compare the power of the ANOV F and Wilson Chi-square 
fests by the null hypothesis being tested? »Each figure, con- 
Gaans three sets of curves; one for ,each error distribution 
mpe.. | lnethorizontalyarpument)ofoverror degree) corresponds 
Tosthe degree of non-normal error; distribution, type shown in 


me distribution) curves! of Appendix C. 


B. ANOV F TESTS 

Figures 1 through 3 show that for a 3x4 factorial with in- 
teraction and 6 observations per cell the power-of the F test for 
Mattieciteces and interaction effects hypotheses are unattiecred 
byetne three types of error non-normality. The range of power 
change from the estimated power with normal error is only 
[aieor to +°0.02 over all three hypotheses. It appears that 
Peere should be no concern ' relative to degradation of the 
power of the F test because of error non-normality, even in 


extreme cases, as long as the data is unimodal. 


oF WILSON CHI-SQUARE TESTS 

The below curves indicate that the Wilson Chi-square 
tests are not “distribution free'' as claimed. The power of 
the ttests ‘for main effects and interaction effects are sen- 
Saeive to the shape of the error distribution. 

The normal error power estimate for the Wilson A effect 


test was 0.47. Non-normal error in thatthe test resulted 


27 


im ,a range of power change of--0\40 Gailolent platykureic)) co 
+0.27 (violent skewed) from the normal value. For the B ef- 
fect test the range of power change £rom the nomnal error 
estamate of 0.74 was -0.19 (violent platykurtic) to +0225 
(vtotent skewed). For the AxB effect test the range of 
povecr schange from a.norm of 0.25 was -0.07 to +0211. with 
the same error type extremes as before. 

im general as expected the powerio the Wilson Chi-square 
Beces were: lower than the power of the comparabidlie) F tests. 
Nac the error distribution was N(0,4) £or both, the power 
mee Cit-square test for A €fiecte mwas oo per Centwor the 
Pemer or Lhe comparable § test, the power of the Chi-square 
Peron b Ierrect was 7/7. .per Cent or Ene, power Grape Hocese, 
ame tite power of the Chi-square test for AxB effect was 38 
Retrceitwot that of the F test. However, there was one ease 
where the power of the Chi-square test was higher than that 
Semere ke test (0.97 versus 0.95 in the™téstitor Bb effect un- 
der the condition of violent skewed error). 

une error effect trend>for a particular errog type was 
consistent over the three hypotheses tested. Note the simi- 
Paoticy imeashape, for-example, of “the skewed™error-Waison 
power curve in Figures 1 through 3. The rate of change in 
power with respect to error degree (as error varied from 
Morality) was, however, significantly less for the Chi- 
pamare test for interaction under the three error types than 
“eowas im the Chi-square tests for both main effects under 


equivalent error types. 
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FIGURE 3. 
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VI. DISCUSSION 


A. WEESON: TEST SHAPE SENSITIVITY 

TE°%iS apparént from’ Fipures’ i through’ 3=that” therdits-— 
EribuUtionsS Of the Wilson’ Chi-square’ tést statisties under 
the-alternate hypotheses are sensitive’ to the shape of the 
error distribution. The question aFrises@as, €O whether ele 
Peseributions of thesé statistics tnder’ the null hypotheses 
Menace Sensitive ‘tothe ‘shape"orVtheverror distribution; 
enaents, whether the type’I error (alpha) is+changing with 
eaem degree"of error distribution. 

tepinvestigate this, level of Siematicance estimares 
weresmaae under the four degrees of skewed error distribu- 
prom by determining power with the model Coefficients Ser 
equat-to Zero and Chi-square threshold values set for 
mipha =~ 0.05. Results were obtained and compared to evel 


GLesienificance results with N(0,4) error: 


A B AXB 
WILSON SKEW #1 0624" 30524 .0489 
WILSON SKEW #2 206594? 05350 .0432 
WILSON SKEW #3 "0659 =“505.356 ras Or CW 
WILSON SKEW #4 0649 § 20524 .0454 


WILSON N(0,4) £0586 “£0436 «Arde 


Although the true levels of significance were slightly higher 
under the skewed error, they were higher by approximately the 


Same amount in all cases. On this basis 1t is concluded that 


SZ 


the, distributions of, the Wilson Chi-square. statics,are only 
Sensitive, to othe error, distribution ,understhe alternates, -— 
potheses. 

Since the test as proposed by Wilson uses the Chi-square 
SasEhe -<approximaté distribution of »the test statistiespit ws 
evident that this approximation does hold under the null 
mpporkesis (at least in the right hand tail of the dustribu- 
E16n) but that the degree of approximation of the non-ceneral 
ar saquare under the alternate hypothesis is sensitive. to 
Gnanges in the error distribution. Sawrey [15] has labeled 


Suyenetests as ‘'Semi-nonparametric." 


B. WSE, OF THE,WILSON TEST 

ihe ,above’ should.not»be,interpretedstoimean thatythe 
Watson test is invalid and shouldbe avoided.) .lt)is obvious- 
iyeinser.or to the ANOV FE test and»should not be chosen when 
Picecata Permits utilization, of;the)parametric ANOV. How- 
even, theyWilson-test,,to,the author's knowledge; ,1sythe 
simplest.of only.two-procedures. applicable to testing, for 
interaction when the data is qualitative and measurements have 
Beensobtained only on an ordinal’ scale (see.Mood [le], for the 
Geen). it should be used in such cases.with the realization 
that its accuracy depends upon the shape of the underlying 
Grcor distribution. After histogramming the data, the ,re- 
Ewes Of, this paper, may be used to.provide.géeneral,ansight 
felativeto the question! of what,power to: expect... ,Pertinent 
power estimates for a particular design may be obtained by 


employing the computer simulation method presented herein, 
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provided that the error distribution (unimodal) can be iden- 
t2zfiedofrom the data and the typerinteraction | cansbescharae- 
texpzed:. Twenty-cightyandsonechalf minutesacniane 1BMa560 
computer were required on\ the average in«this study pion! ob- 
taining power estimates for the normal case and one non- 


normal error distribution. 


C. AREAS FOR FURTHER STUDY 
ee Owed bist CLency, 
A typical question facing a prospective user of the 
Wilson test is that of how many replications are necessary 
With a particular design to attain a desired power, given 
Geparercular error distribution based on preliminary samplane, 
This is a problem in estimating power efficiency for the 
hieesem testiand|isxavinatural extensionyo£ithiststudyanalhe 
Same simulation model could be used. 
eae tferentylypeioth Intenaction 
Thespresent yesearchycouldybe extended) tojinelude 
etiemmcharacterizations of interaction.) ilnotheogcoursero£t 
Phaenstudy ithe author atwone stage characterized! interaction 


; oi a Pee Incompléte results, based on only 


by ae 15 5 =a 
ZOGsbatches of data, indicated that. theyestimated power, for 
ime Fetests was the same as that for the characterization 
Seabed herein (1.€., Ce = a; oe but that the estimated 
power for the Wilson Chi-square tests was considerably dif- 
ferent from that under the present characterization. 

5, ESfect of Homoscadacity on Power 


It is believed that a computer simulation method, 


cimaiar te the one used here relative to non-normality, cougd 
ZA 


ee i aor. goed 
Vbar dyes. bere sigéG-yineeT- . 


: ~ 


otons coatimt «#21 


| ran ot A iGhe one qs ot aHk? 


be used to study the effect on power of the parametric ANOV 
requirement of homoscadacity. Error distributions could be 
eenerated with different) degrees, of error, variances data 
tested by the ANOV and WILSON subroutines, and the results 
analyzed. 
fee Sema -Nonparanetricoleses 

Another research area recommended: as that of,!'semi- 
RoOiparanetric’ tests.: An® appropriate thesis maght) consist 
Seecxtracting ali such tests from the! literature) and: then 
showing why they are semi-nonparametric with resulting im- 
Plveations. Reference lSewould: be a goodsStarting’ point 


heme stch a4 thesis. 


5. Effect of Sample Size on Non-normality Effect 

A final extension of this) Study mught be tovanalyze 
ijewertect of sample size (replications per cell) om the power 
eee ANOV F and Wilson Chi-square tests under the same ‘con- 
Gitewons Of Error non-normality. Would a. doubling or tripling 
Siesample size tend to flatten out the Wilson power curves 
ciewmeain Figures 1, 2, and 3 of Section V or would they just 
Bewsurrted upwards? Would the ANOV F tests still be unat- 
fected by error non-normality if the sample size were only 


emoereplications per cell? 
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SHmIOMeT. 


Asixv 


VII. SUMMARY 


A complete simulation method has been presented for 
estimating power for both parametric ANOV tests and Wilson 
non-parametric ANOV tests. <A 3x4 ANOV simulation model 
was used with six replications per cell? s*interactioniwas 
Gharacterized by ob); = a5 C, with oes eonstant >, %in= 
Cressi, evenly spaced, and’ i°c. -="0.*VError non-normad ity 
Was characterized in four degrees of three unimodal error 
faseripution types: skewed} leptokurtic, «and® pillatykurtic. 
It was shown that when the error was normal the Wilson Chi- 
wamene test for A effect was 58 per cent of that for the 
eemporable F test, the Chi-square test for B effect was 77 
Poeneecent of that for the F test, and? the Chi-squaré test 
top Sxb ertfect was 38 per cent of that for, the. comparable 
Hecese.) |it was further shown that the Wilson Chi-square 
Posse were not distribution free as claimed by Wilsom but 
MememscnSitive to the parent distribution Shape. ~Lepto- 
Kkurtic and skewed error distributions increased the power 
of the Chi-square tests above that estimated with normal 
eumen., Platykurtic error distributions decreased the power 
@£ the Chi-square tests from that estimated with normal 
error. The power of the ANOV F tests were unaffected by 


even the extreme cases of error non-normality. 
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APPENDIX A: DESCRIPTION OF THE WILSON TEST 


1. The median value, Ma: for the entire set of n ob- 
servations is determined. The number of observations less 
than My: represented by Ny » is then caleukated: 

2. A 2XFxXcC contingency table 1S constructed where 7 
and © represent the number of rows and columns of the de- 
Sien and the “third dimension 2" corresponds to the divyi- 
Silom of sicores by Ma: The frequency enexries for the 


contingency table are represented by pt the number of 


Te ji 
observations less than Mg for’ the cell imesow 21 and colunn 


fmeeecne table. It follows that 
i= = Ac >. Fb perme Cia) 


The below contingency table example is given for the purpose 


Dieclaritying notation: 


M. >= 9100 234851 


d 
FACTOR A 
1 Z S | 4 ea 
it 5 6 Z, Z £5 
FACTOR 
B 2 3 Zz 4 z. avi 
3 4 4 1 i 10 
£5. ee, TY ii 5 36 
b #7 
al 1 
>> = 
= 


Si 


oi: ES a 


ro ="5 


c= 4 
eae = # observations < Ma 
i 36 
my = "7 2 


53. Since the number of observatioms for each cell an 
the ANOV design of interest are all equal and Mg can be cal 
emulated such that ne 5 n/2, the total Chi-square value can 


be computed as follows: 


Xp > ‘) iar Gn ; ) (eee) 
aes) 
where n/2rc represents the expected frequency under the null 
hypothesis that the main effects. and interaction effects 
peoauce no change in the distribution, of scores. XT has 
(peal) degrees of freedom. 
ae ihe CGhi-square, values Of the xow citreces sand columm 


Sefoers are computed using the marginal totals of the 2xrxe 


SGntamnecency,table. 


4r ans 
XR Shee 2 [ofa ; 7] Ue) 
il 
and 
ie ay ees ie : 
AG a i eg 2€ (bse) 
ae Pp ae = 
where Bos. j mead and pec Ae Ns before, the sexpee 


ted frequencies for the main effects, n/2r and n/2c, are ob- 
Gained for the null hypotheses that the distributions of 


scores are identical for all levels of the row or column 
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effects, XR and XC have (r-1) and (c-1) degrees of freedom 
meSpective ly... 
Ss The Chattsquare walweifior the interaction ettect ens 


computed by subtraction. 


| 


| MG Soke Xp Ne (5) 
XT has (r-1)(c-1) degrees of freedom. 

6. The tests for the main effects and interaction are 
made by comparing the obtained values of XR: XG and XI with 
mamues from ;the eumulative Chi-square distribution for the 
apprapriate deprees of freedom and desired significance 
level. 

ie Walson’ f6]., (‘citing Rao (1952) tand Gotham (hb 9545 
no problem concerning small ex- 
Beevea £requencies as long as the contingency table has 30 
Or more degrees of freedom. He further conclluded that 
eraumary Chi-square’ tables were applicable as Jong as /the 
$0 degrees of freedom criteria held. 

Ss.) Wilson (6) included formulation for Chi-square 
values when Na» the number of observations greater than or 
equal to Map weno ‘equal Ny and when the ee are not falda 
equa In addition he extended application of his test. to 


experimental designs with other than two factors. 
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APPENDIX B: DEVELOPMENT OF 22) CELE MORES 


1. The Mathematical Model 


Gi es a ee Ce aa 


| 
| 
| 
meeexpressed in matrix notation as 


=e = x Be ts ie 


Dl ites § Do Die aguas Gia eo 


| 0:6.) | ju 
nsec! Ay 
1100] | Ee 
i fe ..I | Bi 
ee.” : Ba 
leo 4 | 3 
120009 | ] ae 
‘ea : , ABi2 
| L400 | | “Bi i 
mee (8). at ted ) | 46a | + 
BS Tae) 0 S ° Al22 
1100 \ B23 
V2 

1010 | | ane 
OnOi | x3.34 
bole | l 
| O10 | | 
Lolo. “4 l 
1010 | | 
1010 | | 
i (oycer WP | 
idot | j 
foO1 | l 
lool | l 
100) | l 
100] | | 
1001 | | 
100] | 

(72520) (20xi) 
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2. Model .conditions -are: 


Ge. = 0 


ag * OP) 


ee) 91 
(0B) 54 
Sab 
(08), 
OB) 13 


(OB) 44 


+ 


+ 


(a8) 5, 
(GE 32 
foe 
Cee 


(0B) 53 


+ 


CO 


oo Rewriting the 


Coa 
(EI 
(o0 33 
Ceicai 
CP co, 


(08) 55 


(OB) 2, = 


(2-2) 


(2-3) 


(Zs) 


(2-5) 


(2-6) 


(2-7) 


(2-8) 


(2-9) 


(2-20) 


above and eliminating duplication: 


(0B) 55 
(a2 


(a8) 99 


(08) > 5 


(OB) o4 
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= eee 


- (a8) 55 


(22D) 


(Za? 


(Gas) 


(2= 14) 


(Z2=25,) 


(2-116) 


(2-19) 


(2-18) 


fhus the matrix equation can be reduced to am equation) an 


emily 12 parameters (vice 20). 
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4. The new new matrix equation is expressed on page 


The following cell models are obtained by expanding the 


new matrix equation. 


| 
| 


Model for 


tik Me OY 


Model for 
Mog Vt Oy 
Model for 


mere Oy 
Model for 


(08) 45 

Model for 
mie Mt 18S 
Model for 


a i, 


Model for 


oe 1S 


Model for 


Sole (yes 
(0B) > 


Model for 


celilone:: 
tee CoB) 54 + 234k head £ e864 
cell two: 
2B) ft CoB) > + Zy9x kei} s,6 
eel three: 
+ B. a (08), 2 + 2435 koi, s* 68 
SIL Meoioses 
- B, - By - Bz - (08),, 

(oB)53 + 25 ae kel, =, 6% 
Cell erie. 
4 eo CoB) 54 + Zoi, kel, 10% 
cel De:sace: 
* Bo * (aB)55 * 255, k=1,*° 64 
cell) sevens: 
+ B. + (a8). + Zo 34 Rei wer 6e 
eed eons: 
Bg Boe iii ee Ia 

(08) 52 + Ai k=l 78° 6% 
cell names 
7 Oy Hy Biya teSE) aie oe 

Kee esGr 
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(2213) 


(2270) 


ew) 


CL 


C22, 5;) 


(2224, ) 


@a25) 


(2-26) 


hy 


eee 


nw ee se 


ee | 

HO | | 

I. 0: Ma 

Cee l 

| 0 l | 

| 0 ] l 

0: ele tee >I 

ee ee -| 

Ors! ¢l 

Gi 

6 ated 

Oe eel 

01 | 

0} 

Cet iesl | 

Oneal a5 

mira ry 

het q -| 

ae | =|| 

spay 8 4 a 

~| + | =|| 

| + | 

ele es Sater 

erent =) 
(72x12) 
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=| 


(12x1) 


Z3\6 
2321 


a ars. 
EAs 1 


| Sa96 


234 | 
2346 


(72x1) 


Model for cell ten: 


k=1 == 46 42528) 
Model for cell eleven: 
wae © Sb Sy 3 Op BBs Bee (ee) 


gta Zs 


ror k=156 B61 2229) 


Model for cell twelve: 


te ee 8 Bee tee 


+ 


CoB} i> * CeR)7, > (98)> 7 (88) 


Cpe kK=1, 9-464 (2-30) 
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APPENDIX D: DEVELOPMENT OF MODEL. PARAMETERS 


Ps* "The power ‘eurve for determining theoretical peme. 
som the tést “of anteraction, *Sx4-ANOV model itis sattached 
tb this appendix.,— Numerator degreés of srrecdom vane xc, 

Pe fe-1), and denominatorJdegrees ot freedom axe 60, 
ae 1): where r-1s the number of rows (5), © as the nun- 


Ber of columns (4), and n is the number of replications 


Bemece|t.(6),: , For a.desired power,of (0,07 at.a level.of 


puemeracance of 0.05, d= Lad. 


IES From Reference 11 


1G (e 
2 aS it nN wt ; : ‘ 
CAXB - of ipl Call sat os > (08945 = (te3) 


iH 
= 
OV 
oO 


Geary 
Since a variance of 3.98 was actually obtained in simulation 
pietae N(0,4) error, this value was Substituted for o7. 


watues for r, c, and n stated above were also substituted. 


imena. rearranging (4-1) 


3 
» s (08)?, = ee (4-2) 


3. Any combination of (ap)35 2 such ‘that (4-2) toltds 


will give the desired power. But the interaction was char- 


acterized by (08) 5; = oe with caus evenly spaced, constant, 

increasing with 8,, and 2 ra 0. Initial values forces were 
: J 

aso arbitrarily chosen as Cc, = = Cy = = lle Cz = i, and es 
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b | xine ta 


Se dee ae 


ae initial wadues fox a; were also arbitrarily chosen, 


Subject to the condition £ a, = 0, to be a, = -1.03, 
i 


= CEA az = Ok, Sic 


A. Substituting these values fox Os and 9c. 


| VO MCS ae Me eck ea 
a j 1 j 


| 


= 


#ee+ ((0.75)(3) = 34.0360. 


Bamseeach value of ithe initial selection for ¢i was €60 
vy 
ianee by the multiple (34.0360/7.8387)- = 2.0837. Initial 


“48 mere then divided by 2.0837 ‘to obtain: 


Cc, = =. 43971.=.-1.44 
Cy = 70.47 90 = -0,48 
Cz = 0.47990 = 0.48 
Cy 1.43971 = eas 


me. Using the oricinal a,'s and the) “adjusted CBs 


values of Core = = Kea) were calculated to be 
(a8) 44 = a,C, = Wea 852 
(a8)4>5 = a)C> = 0.4944 
(aB) 52 = a4,C, = -0.4944 
(aB) 54 = eas =A SZ 
(a6) 54 = G5C, = =O 4032 
(a8) 55 = 50, = -0.1344 
(0B) 5% = oC = 0.1344 
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if 


iw eu az a oe ws 4 Sis ¢ tires: . ols 
| : 5 Ae fh bad e* 34, 


(08) 94. = Oe OeebeZ 


Zz 4 
(08) 24 = a,c, = -1.0800 
(a8) 25 = O20, = -0. 3600 
| (a8) ,, = a,c, = 0.3600 
| (a8) 24 Fig nce ie 1.0800. 


| 
These values of oe met the model conditions stated in 
Appendix B (i.e., : (08) 5 SO pelt ates .65) Cand ; (0B); . = 0, 
Po eie 54) : 

Goa Values of Re were then chosen amutranily subject 
Eo, the condition ; Bs = 0h Vale's swere ssellee veda ™ elie 
neighborhood of the oF values so thatymo. Ssamehe: main e£- 


sSe ee see ere eae a) es Sore AE if) OR Ree Hie aR See eS la) = 4 nN 7 
| a & Tah’ en ont (GN GB iT es ie iri i Wiest uit Cl DL en YE oe LG Or == SS OR aes a) 


i 


= 1103, 103. 


3 Ba 
Lo lhe overall. mean, represented by ja anMequations 


Paeeurnomeh (14). was~ chosen arbitrarily, to be 100.00. 
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APPENDIX E: COMPUTER FLOW DIAGRAMS 


1. Main Program 


INITIALIZE 
PARAMETERS 


rap \ 
iy \ ve 
COUNT 


POWER FA 
POWER FB 
POWER FAXB 


TOTAL COUNT FA/N 
TOTAL COUNT FB/N 
TOTAL COUNT FAxB/N 


CALL SUBROUTINE WILSON}- — — 


aoe eernee ae 7 RERUN 


ARE x2A, 
VAR oc AxXB 
DON'T >THRESHOLD VALUES 


COUNT 


COUNT 


BZ 


- - 
= 


TOTAL COUNT x7A/N 
TOTAL COUNT CYZB/N 
TOTAL COUNT y27AxB/N 


POWER x7A 
POWER y2B 
POWER x*AxB 


Wow ou 


N_TIMES 


NOTES: 


*This package was changed for each level of each type 
error. 


Selected computer programs used are attached follow- 
ing appendices. 


a Subroutine ANOV 


i Try AN 7 
i ee ’ 
Peres o { 


MATRIX. MATRIX ROWS 
1-6 EQUIV TO DESIGN 
ROW 1) ETC. 


mn” Rana = Ne sh s 
fe Wao rin 1 Qva 
a Vv wv as a Vaart 


CALCULATE SUM OF BACH 
OBSERVATION SQUARED 
YSOR TCIL oO) 


CALCULATE SUM OF EACH 


OF 4 DESIGN COLUMNS 
AND ITS SQUARE. 
TDID( J), TDIDSO(S) 


CALCULATE SUM OF 
EACH OF 12 DESIGN CELLS 
AND ITS SQUARE 
TIID(I),, TEIDSOCI) 
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CALCULATE SUM OF EACH 
OF 3 DESIGN ROWS 
AND ITS SQUARE 
TEDDGL)~eueD DSO) 


COMPUTE OVERALL SUM 


OF OBS. SQUARE IT. DIVIDE 
BY 72 TO GET CORRECTION 
FACTOR 
COR. = TDDDSQ/72 


COMPUTE TOTAL SUM OF SQUARES 
TSSu= ye VSO.) aL iCOR 
apy 


COMPUTE B SUM OF SQUARES 
Ah 


BSS = F° TpIDsOG;)/18 = cor | 


io 


COMPUTE A SUM OF SQUARES 


ASS = : TEP (1) / 24. = COR 
i=] 


COMPUTE AxB SUM OF SQUARES 
1 
AxBSS = i TIJDSQO(M)/6 - ASS = BSS = COR 
m=1 


f 


COMPUTE ERROR SUM OF SQUARES 
BSo7 =, too, a. (los, +. bos) SAB oS) 
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COMPUTE A MEAN SQUARE 
AMS = ASS/2 


COMPUTE B MEAN SQUARE 
BMS = BSS/3 


COMPUTE AxB MEAN SQUARE 
AxXBMS = AxBSS/6 


COMPUTE ERROR MEAN SQUARE 
EMS = EGS/00 


COMPUTE E-RATIOS 
FA = AMS/EMS 

FB = BMS/EMS 

FAxB = AxBMS/EMS 


' 
1 
L 


RETURN 


Bc Subroutine Wilson 


ORDER 72 OBS IN 
COLUMN VECTOR 


FIND MEDIAN OF 72 OBS 
XMED = (YOBS(36) + YOBS(37))/2 


FIND FREQUENCY OF. OBS < MEDIAN 
EN EACH CELL OF Z2x5x4 
CONTINGENCY TABLE 
IF (YOBS(I).LT.XMED)NBSUM = NBSUM+1 
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FIND CONTINGENCY TABLE ROW SUMS 
NEFID = | NEE(I.J)e Pues 


FIND CONTINGENCY TABLE COLUMN SUMS 


NBFID 2 eINEE Gage] WeI= LEA 


FIND TOTAL CHI-SQUARE VALUE 
ot ak) Cody Gy L 72 2 
= fie ie ee ee 


Peis erecenety ia 


7 nr ' vr. 
VALUE | 


1 
cure 


dts pe 
FiND CHi-SQUARE B 
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APPENDIX F: DETERMINING TEST REPLICATIONS 


Ek. ‘Ten ANOV and ten WILSON subroutines were executed 
on data generated with the simulation model, N(0,4) error. 
meer of each of the F and Chi-square statistical tests 
for main effects and interaction was computed by the method 
Rosin PMeAppendix 5. ~The subroutimes were then executed 
fen more times and power computed in a similar manner. This 
Was repeated until 200 ANOV's and WILSON subroutines had 
meecmecxecuted consecutively giving a sample size of 20 power 
mabues per test, each power value based on the number of 


mace null hypotheses rejected out of ten trials. 


Z— Sample) Variance washthen computed) for each) test). 
zZ0 
BN oe i s _ Fy 2 a 
a (X; X) (G21) 
O ; 
1=1 


where X; is the reo power value and X is sample mean power 
Maiwue based on the 20 Kr Ste elias = 20. 
meusine the Student's ¢ distribution table. the 


mange for k was determined so that the following equation 


held. 
Prob] —— <t, , === || 2-156 (6-2) 
2Vvk fe) 2Vk 
mmere e = .04, n_-1 = 19, and l-a = .95. 


mm For each of the six statistical tests involved Ny; 
the number of replications required for desired confidence 


on the value of X, was determined by: 
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Ny = Max (5 gals, no) (6-3) 


where [S*/k] represents the greatest integer < the ratio. 
5. The value obtained for Ny was then multiplved by 

ten to obtain N, the number of WILSON and ANOV subroutines 

to fmemwexecuted for desired contrdence, Ihe multapiiceation 


Mmeeemecessary since ten replications were, required for each 
| 
maine of X.. 

oe ihe mMaximumpgot the Nevalues tor the six tests an 


molvyead was then determined and rounded up to the nearest 


mOO> Results are summarized below: 
A B AxB 
N,ANOV = Max (L560, S20 1670); =" 1670 (6-4) 
N, WILSON - Max (S618., 2938, 1960) = 3616 (6-33) 
N = 3700 (626) 
mee Determining test cwas “the \Chi=square “pest iforvA ef- 


ene Ihe computer program utilized is attached following 


mene appendices. 
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SePENDIX G: THEORETICAL POWER, ANOV MAIN EFFECTS TEST 


tay -Reterence Li poives 


| (7-1) 
| (0) 26 


Here n = number of replications, 6; c = number of design 

columns, 4; r = number of design rows, 3; o*% = desired 

Mertance, 4; and 2 OF = sum of the squared a; parameters 
i 


from Appendix D. Substituting 


g2 = (6)(4) (1.7018) _ 5.49 


and 


meeeapplicable power curve, attached to this appendix, has 
mumerator degrees of freedom = r-l = 2, and denominator 
Meprees of freedom = rc(n-1) = 60. Power of the test, as 


Meeeeeerom the curve, is 0.81 at the 5 per cent level of 


Sapniticance. 
Of . 
ibe we aS 
ore Ajeet ea (7-2) 
B 2 
G1 
mere > 85 = sum of the squared 25 2 Erom Appendix Drm= 47243560. 
J 
Substituting 
0? = (OSC 2450) 4.77 
eles) 
and 
dp = 2.18 
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The applicable power curve, with numerator degrees of free- 
dom = 3 and deonominator degrees of freedom = 60, gives 


Meer or this test |= 0.96. | The power curve |is attached. 
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